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1. 


Ir.troduction 

Vntil  quite  recently,  the  basic  approach  to  non-linear  filtering 
theory  was  via  the  "innovations  method,"  originally  proposed  by  Kailath 
ca.196  7  and  subsequently  rigorously  developed  by  Fujisaki,  Kallianpur  and 
Kunita  [1]  in  their  seminal  paper  of  1972.  The  difficulty  with  this 
approach  is  that  the  innovations  process  is  not,  in  general,  explicitly 
computable  (excepting  in  the  well-known  Kalman- Bucy  case) .  To  circumvent 
this  difficulty,  it  was  independently  proposed  by  Brockett-Clark  [2] , 
Brockett  [3],  Mitter  [4]  that  the  construction  of  the  filter  be  divided 
into  rwo  parts:  (i)  a  universal  filter  which  is  the  evolution  equation 
describing  the  unnormalized  conditional  density,  the  Duncan-Mortensen- 
Zakai  (D-M-Z)  equation  and  (ii)  a  state-output  map,  which  depends  on  the 
staristic  to  be  computed,  where  the  state  of  the  filter  is  the  unnormalized 
conditional  density.  The  reason  for  focusing  on  the  D-M-Z  equation  is  that 
in  is  an  infinite-dimensional  bi-linear .-system  driven  by  the  incremental 
observation  process,  and  a  much  simpler  object  than  the  conditional 
density  equation  (which  is  a  non-linear  equation)  and  can  be  treated  using 
geometric  ideas.  Moreover,  it  was  noticed  by  this  author  that  this 
equation  bears  striking  similarities  to  the  equations  arising  in 
(Eucli dean) -quantum  mechanics  and  it  was  felt  that  many  of  the  ideas  and 
methods  used  there  could  be  used  in  this  context.  The  ideas  and  methods 
referred  to  here  are  the  functional  integration  view  of  Feynman  (for  a 
modern  exposition  see  Glimm-Jaffe  [5]).  In  many  senses,  this  viewpoint 
has  been  remarkably  successful — although  the  results  obtained  so  far  have 
beer,  cf  a  negative  nature.  Nevertheless  the  recent  work  has  given  us  a 
deeper  understanding  of  the  D-M-Z  equation  which  was  essential  for  progress 
ir.  r.or.-linear  filtering,  as  well  as  in  stochastic  control.  The 
variatronal  interpretation  of  non-linear  filtering  given  by  Fleming-Mitter 


[6],  Mitter  [7]  and  the  work  on  the  partially  observable  stochastic 
control  problem  by  Fleming-Pardoux  [8]  can  be  considered  to  have  arisen 
from  the  "state-space"  interpretation  given  to  the  filter. 

This  is  an  expository  paper  and  contains  no  original  results.  For 
rigorous  derivation  of  some  of  the  results  presented  here,  the  reader  is 
referred  to  the  doctoral  dissertation  of  Ocone  [9] ,  Hazewinkel-Marcus  [10] 
and  Sussmann  [11] .  The  interested  reader  may  also  read  with  profit 
Hazewinkel-Willems  [12]  and  Mitter-Moro  [13]. 

2 .  The  Filtering  Problem  Considered,  And  the  Basic  Questions. 


We  consider  the  signal-observation  model: 

dx.  =  f(x,)dt  +  G(x,  )dw  x(0)  =  x 

(1)  t  °  0<t<l 

dy, _  =  h(x,_)dt  +  dn  ,  where 

t  t  t 

x,  w  and  y  are  iRn,  IP111  and  IR^- valued  processes,  and  it  is  assumed 
that  f,  G  and  h  are  vector- valued,  matrix- valued  and  vector- valued 
functions  which  are  smooth  (which  mean  C°°- function) .  It  is  further 
assumed  that  the  stochastic  differential  equation  (1)  has  a  global 
solution  in  the  sense  of  Ito.  It  is  further  assumed  that  xfc  and  Ti  are 

r  I,  ,2 

independent  and  E  /  |h(x  )|  dt<0°.  For  much  of  our  considerations,  the 
function  h(‘)  will  be  a  polynomial. 

It  is  well-known  that  the  unnormalized  conditional  density  p (t,x) 
(where  we  have  suppressed  the  y(  )  and  co- dependence)  satisfies  the  D-M-Z 
equation : 

P  P 

(2)  dp (t , x)  =  [s£o  -  j  ^  hi2(x)j  p(t,x)dt  +  hi (x) p (t ,x)odyt  , 

i=l  i=l 


where 


n 


(3) 


^o 


= 


.  “  ,  dxH  dx. 
1,3=1  1 


-(g(x)G'  (x))  .  ,4>  -  2 


Sr-  fi  (x)$ 

dxi  i 


3. 


and  the  •  denotes  the  Stratanovich  differential.  It  is  imperative  that  we 
consider  (2)  as  a  Stratanovich  differential  equation,  since  the  Ito- 
integral,  because  it  "points  to  the  future,"  is  not  invariant  under  smooth 
diffemorphisms  of  the  x-space,  and  we  want  to  study  equation  (2)  in  an 
"invariant  manner." 

We  think  of  p(t,*)  as  the  "state"  of  the  filter  and  is,  what  we  have 
referred  to  before,  as  the  universal  part  of  the  filter.  If  <f> ,  say,  is  a 
bounded,  continuous  f motional  then  the  filter  typically  is  required  to 
compute  E  (cf>  (xt)  )  ,  where  =  a(ys,olslt).  If  we  denote  by 
<j>tA_E(<J>(x  )  LgT  )  ,  then  <(>  is  obtained  from  p(t,x)  by  integration: 

(4)  $  =  f  <J>  (x)p  (t,x)  dx/f  p  (t,x)dx 

"W1  IRn 

/\  A 

d)  will  be  referred  to  as  a  "conditional  statistic,"  and  no  matter  what 
t  t 

we  wish  to  compute,  p(t,x)  serves  as  a  "sufficient  statistic." 

One  of  the  questions  we  want  to  try  to  answer  in  this  paper  is:  when 

/"V 

can  <j)  (corresponding  to  a  given  <!>)  be  computed  via  a  finite-dimensional 
filter?  The  other  remark  to  be  made  is:  we  are  interested  in  computing 
the  fundamental  solution  of  (2)  so  that  we  can  evaluate  p(t,x) 
corresponding  to  any  initial  condition. 

To  proceed  further,  we  need  to  make  a  definition.  By  a  finite- 
dimensional  filter  for  a  conditional  statistic  cj>  ,  we  mean  a  stochastic 
dynamical  system  driven  by  the  observations: 

(5)  dE  =  a  (E  )dt  +  B(E  )ody. 

t  t  t  t 

defined  on  a  finite-dimensional  manifold  M,  so  that  and  U (g  )  and 

3(Cfc)  are  smooth  vector  fields  on  M,  together  with  a  smooth  output  map 

(6)  cj>  =  Y(?t),  which  computes  the 

conditional  statistic.  Equation  (5)  is  to  be  interpreted  in  the 
Stratanovich  sense  for  reasons  we  have  mentioned  above.  We  shall  also 


4. 


assume  that  the  stochastic  dynamical  system  (5)'- (6)  is  minimal  in  the 
sense  of  Sussmann  [14]. 

For  the  definitions  and  properties  of  Lie  alqebras  and  Lie  Groups 
used  in  the  sequel  the  reader  is  referred  to  the  Appendix. 

3 .  Lie  Algebra  of  Operators  Associated  with  the  Filtering  Problem 

Consider  the  Lie  algebra  generated  by  the  unbounded  operators 
P 

SB-  SB  -  q-  /  h2  (x)  and  h.  (x)  ,  i  =  i,  —  p, 

O  Z  A-J  l  l 

1=1 

where  the  operators  SB  and  In  (x)  (the  hu  considered  as  multiplication 

operators  <j>  (x)  In  (x)<f>  (x) )  act  on  some  common  dense  invariant  domain  SB 

(say®  =  C  (IrP)  or  SB^)  )  - 
o 

This  Lie  algebra  contains  important  information  and  if  it  is  finite¬ 
dimensional  then  it  is  a  guide  that  a  finite  dimensional  universal  filter 
for  computing  p(t,x)  may  exist. 

Care  should  be  taken  in  interpreting  this  statement.  Firstly, 

referring  to  the  definition  of  a  finite-dimensional  filter  in  (5),  there  is 

a  Lie  algebra  of  vector  fields  associated  with  it  which  in  general  is 

infinite-dimensional.  Therefore,  the  fact  that  the  Lie  algebra 

<£k{SB,  h  ,  ...  ,  h  }  is  infinite-dimensional  does  not  preclude  the 
T  P 

filtering  problem  having  a  finite-dimensional  solution.  Secondly,  even  if 

i£h  {SB,  h,  ,  ...  ,  h  }  is  finite-dimensional  it  does  not  mean  that  a  finite- 
1  P 

dimensional  filter  exists.  The  reason  for  this  is  that  constructing  the 
filter  requires  integrating  the  Lie  algebra  arid  it  is  a  well-known  fact 
from  the  theory  of  Unitary  representations  of  Lie  Groups  that  not  all  Lie 
algebra  representations  extend  to  a  Group  representation  (see  the  Appendix 
of  this  paper) .  However,  it  is  still  a  good  question  to  ask  as  to  whether 
examples  of  filtering  problems  exist  where  the  Lie  algebra  SBh.{SB,  h^,  ...  h^} 
is  finite-dimensional  and  also  how  big  is  this  class.  The  answer  to  the 
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first  part  of  this  question  is  positive  but  the  answer  to  the  second  part 
of  the  question  appears  to  be  that  this  class  is  small. 

Example  1:  {Kalman  Filtering) 

dx  =  Ax  dt  +  bdw^  A  =  n  x  n  matrix 

t  t  t 

b  =  n  x  1  matrix 

dy  =  c'x  dt  +  d  c=nxl  matrix 

Jt  t  t 


(8) 


Then 

n 

2 

•k 

_!  V 

9  0  ^ 

i — i 

|fM 

1 

3xi8xk  ij  i=i 

\s 

=  SS*  -  I 

o  2 

2 

(c’x)  ,  where 

t —  (Ax)  .  ,  and 
3x .  i 

x 


Q  =  bb' 


Define  the  Hamiltonian  matrix 
/-A'  cc'\ 

E  -  (  I?  and  the  vector 

\  bb '  A  / 


a 


and  the  controllability  matrix 

O  rx  1 

W  =  [a  :  Ect-  .  -E  oO  an<^  assume  that 

W  is  non-singular. 


Define  =  c'x  and 

Z  =  [ad^]1'1  Z  y 

Then  one  can  show  that 

n  n 

(S)  z  =  I  (E1_1a)  X  +  2  (E1_1a)  ~  ,  and 

j=l  J  j=l  j 

(10)  [z^z  ]  =  (E^_1a)  '  /0  -i\  (Ej_1a), 

'  I  o' 


We  can  then  conclude  that  the  Lie  algebra  of  the  filter 


6. 


&  -  span  {SB,  Z  ,  .  .  .  ,  Z  ,  i}  ,  where  the  Z.  ,  ...  ,  Z„  are  independent 
1  zn  1  2n 

by  hypothesis.  Hence,  <^has  dimension  2n+2 ,  and  this  algebra  is  isomorphic 
to  the  oscillator  algebra  of  dimension  2n+2  (see  the  Appendix) . 

3 . 1  Invariance  Properties  of  the  Lie  Algebra  and  the  Benes  Problem. 

The  filter  algebra  is  invariant  under  certain  transformations, 
namely,  dif feomorphisms  on  the  x-space  and  gauge  transformations  to  be 
discussed  below.  These  ideas  are  best  discussed  on  an  example. 

Consider  the  filtering  problem: 


(11)  (xt  =  W 


'dy^  =  x  dt  +  dn 
■  t  t  t 


A  basis  for  the  filter  algebra  !¥  i.s 
1^'  X  '  dx  '  1  ^  '  where 


1  ci  1  2 

SB =  —  ~2  -  —  x  and  this  is  the  4-dimensional  oscillator  algebra. 


It  is  easy  to  see  that  if  we  perform  a  smooth  change  of  coordinates  x^-  $  (x) 
then  the  Filter  algebra  gives  rise  to  an  isomorphic  Lie  algebra,  and  two 
filtering  problems  with  isomorphic  Lie  algebras  should  have  the  same 
filter. 

Now  consider  the  example  first  treated  by  Benes  [15] , 


(dx,  =  f(x.  )dt  +  dw^ 

(12)  )  '  ' 

ldyt  =  xfcdt  +  dp^  ,  where 
f  is  the  solution  of  the  Riccati  equation: 
d.  f  2  2 

—  +  f  =  ax  +  bx  +  c  ,  and  the  coefficients  a,b,c  are  so 

dx 

chosen  that  the  equation  has  a  global  solution  on  all  of  R.  We  want  to 
show  that  by  introducing  gauge  transformations,  we  can  transform  the  filter 
algebra  of  (12)  to  one  which  is  isomorphic  to  the  4-dimensional  oscillator 
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algebra.  Hence,  the  Benes  filtering  problem  is  essentially  the  same  as 
the  Kalman  filtering  problem  considered  in  example  1. 

To  see  this,  first  note  that  for  (12) 


d 

[SS,x]  =  — - f  ,  where  the  brackets  are  computed  on  Cf°(IR). 

dx  o 

Now  consider  the  commutative  diagram: 

d_ 

dx 


cf°(3R) 

o. 


w 


C  (2R). 
o 


d 

dx 


-  f 


C00  (3R) 
o 


C  OR) 
o 


¥ 


Here  W  is  the  multiplication  operator  4>  (x) ->■  'F  (x)  c)j  (x)  and  it  is  assumed 
that  ¥  is  invertible.  Then  it  is  easy  to  see  that 


¥(x)  =  exp  J  X  f(z)dz. 


1  9  9 

Under  the  transformation  ¥ ,  the  operator!?'*  =  —  7 — -  - —  f 

o  2  3x2  3x 

1  9^  1  df  9 

transforms  to  —  * — y  -  —  V (x)  ,  where  V(x)  =  -r—  +  f  . 

2  ox^  2  dx 

It  is  easy  to  see  that  the  Filter  algebra  is  isomorphic  to  the  Lie 
algebra  with  generators 


1_  d^  _  1 

2  dx2  2 


V  (x) 


1  2 
2  x  ,  x 


We  now  see  that  if  V(x)  is  a  quadratic,  then  this  Lie  algebra  is 
essentially  the  4-dimensional  oscillator  algebra  corresponding  to  the 
Kalman  Filter  in  Example  1. 

What  we  have  done  is  to  introduce  the  gauge  transportation 
P  (t,x)  ¥  1(x)p  (t,x)  ,  where  p  (t,x)  is  the  solution  of  the  D-M-Z 

equation  and  what  we  have  shown  is  that  the  Filter  algebra  is  invariant 


under  this  isomorphism. 
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tr 


However,  for  the  class  of  scalar  models  considered  in  (12)  with 
general  drifts  f,  the  Benes  problem  is  the  only  one  with  a  finite¬ 
dimensional  Lie  algebra  (we  restrict  ourselves  to  diffusions  defined  on 
the  whole  real  line) .  For  further  details  on  this  point  the  reader 
should  consult  Ocone  [9]. 

There  is  no  difficulty  in  generalizing  these  considerations  to  the 
vector  case,  provided  f  is  a  gradient  vector  field. 

3.2  The  Weyl  Algebras  and  the  Cubic  Sensor  Problem. 


The  Weyl  algebra  W^  is  the  algebra  of  all  polynomial  differential 

3  3 

operators  TR(x,  ,  ...  ,  x  ,  * -  ,  ...  ,  r —  )  . 

±  n  ox,  ox 

1  n 

A  basis  for  W  consists  of  all  monomial  expressions 
n 


=  x“i  xan  ^ 

1  n  3xp, 


ax  pn 
n 


where  a, 8  range  over  all  multiindices  a  =  (a,,  ...  ,  a  ),8  =  (3,,  ...  3  ) 
r  ,  1  n  1  n 

W  can  be  endowed  with  a  Lie  algebra  structure  in  the  usual  way.  The 
n 

centre  of  W  ,  that  is  the  ideal  g =  {ZeW  I  [x,Z]  =  0,  VXEW  )  is  the  one- 
n  n  1  n 

dimensional  space  3K  •  1  and  the  Lie  algebra  W  / 1  •  1  is  simple. 

Consider  the  cubic  sensor  filtering  problem: 


*dyt  =  xt  dt  +  dnt  . 

Then  the  filter  algebra  generated  by  the  operators 

2 

9?  -  i  ^—2  -  x^ ,  and  =  x^  is  the  Weyl  algebra  W./3R. 

2  dx  21  I 

A  proof  of  this  can  be  constructed  by  performing  calculations  similar  to 

that  in  Avez-Heslot  [16]. 

3. 3  Example  with  Pro- finite-dimensional  Lie  Algebra  (cf.  Hazewinkel-- 


Marcus  [10] ) . 
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Consider  the  filtering  problem: 


xt  =  Wt 


d&^  =  xfcdt 


dy  =  k  dt  +  dv 
t  t  t 


In  [17]  it  was  shown  that  all  conditional  moments  of  E  can  be 
computed  using  recursive  filters.  For  this  problem, j^is  generated  by 


2  9  ^  1  32  12 

~X  3E  +  2  9^  "  2  X 

Si  9  oi  91  . 

x  3E1  '  99E1  '  9?i  '  1 


3  and  x  =  ^  .  A  basis  for  ^  is  given  by  ,2? and 

0,1/ 


g  "L 

Defining  to  be  the  ideal  generated  by  x  ,  i  =  0,1,2,  ... 

it  can  be  shown  3  is  a  pro-finite-dimensional  filtered  Lie  algebra, 
solvable  and  .3/3 ■  is  finite-dimensionall  and  can  be  realized  in  terms  of 

l 

finite-dimensional  filters  corresponding  to  conditional  statistics. 
Remark  1 . 


Other  examples  of  finite-dimensional  filters  can  be  constructed  by 
combininct  the  attributes  of  the  Benes  example  considered  in  Section  3.1 
and  the  example  of  section  3.3.  Thus,  in  example  3.3  the  process  x  may 
be  replaced  by 


dx  =  f(xt)dt  +  dwt 

d.  f  2  2 

where  f  satisfies  ——  +  f  =  ax  +  bx  +  c ,  and  a,b,c  are  chosen  so  that 

dx 

this  equation  has  a  global  solution.  Then  it  is  shown  in  [18]  that  all 
conditional  moments  of  E  can  be  computed  using  finite-dimensional 
recursive  filters. 


Remark  2 

The  Lie- algebraic  and  representation  approach  to  the  filtering 
problem  is  really  concerned  with  the  "classification"  question  for 
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filters.  The  actual  construction  of  the  filter. can  apparently  be  achieved 
using  probabilistic  techniques. 

4.  Existence  and  Nonexistence  of  Finite-dimensional  Filters  and  the 
Homomorphism  Ansatz  of  Brockett. 

In  Section  2  we  have  given  the  definition  of  a  finite-dimensional 

filter.  We  would  consider  (5)  and  (6)  as  the  description  of  a  control 

/\ 

system  with  inputs  y^  and  output  cf)  .  Furthermore,  as  we  have  said  we  may 
assume  that  (5)  -  (6)  is  minimal  in  the  sense  of  Sussmann.  We  thus  have 

/N 

two  ways  of  computing  <j>  — one  via  (2)  -  (4)  (D-M-Z  equation)  and  the 

other  via  (5)  -  (6).  The  ansatz  of  Brockett  says:  Suppose  there  exists  a 

finite-dimensional  filter  and  consider  the  Lie  algebra  of  vector  fields 

generated  by  a(£t)  and  g(£  )  and  call  this  Lie  algebra  L(£).  Then  there 

must  exist  a  non-trivial  homomorphism  between  the  Filter  algebra  #"and 

th 

L(£)  such  that  and  hu  where  g^  is  the  i  row  of  g. 

Conversely ,  suppose  that  the  Lie  algebra  ^cannot  be  generated  as  the 
Lie  algebra  of  vector-fields  with  smooth  coefficients  on  some  finite¬ 
dimensional  manifold,  then  there  exists  no  such  homomorphism  and  hence  no 
conditional  statistic  can  be  computed  using  a  finite-dimensional  filter. 

The  Brockett  ansatz  suggests  a  possible  strategy  for  obtaining 
finite-dimensional  filters  for  computing  certain  conditional  statistics. 
Suppose,  we  are  in  the  situation  of  Example  3.3,  that  is,  the  Lie  algebra^- 

is  pro-finite  dimensional.  Since  is  finite-dimensional  it  has  a 

i 

faithful  finite-dimensional  representation  (by  Ado's  theorem)  and  hence  can 
be  realized  with  linear  vector  fields  on  a  finite-dimensional  manifold 
which  may  give  rise  to  a  bilinear  filter  computing  some  conditional 
statistic.  However,  what  statistic  this  filter  computes  is  in  general 
difficult  to  determine,  and  one  has  to  resort  to  indirect  and  probabilistic 
techniques  for  this  determination.  One  should  also  remark  again  that  #(or 
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any  of  its  quotients)  need  not  be  finite-dimensional  for  a  finite- 
dimensional  filter  to  exist. 


4 . 1  Kalman  Filter  Revisited 

It  is  instructive  to  view  the  Kalman  filter  in  the  light  of  the  above 
discussion  and  solve  explicitly  the  corresponding  D-II-Z  equation.  We  shall 

consider  the  special  case  where  the  Filter  Lie  algebra  is  generated  by 

(id2  1  2  d  ^  .  .  ,  _  .  ^  , 

<  —  ~  ~2  x  '  dx  '  x  '  1  (•  For  a  rigorous  justification  of  the 

calculations  which  follow  see  Ocone  [9]. 

The  basic  idea  is  to  do  the  following  formal  calculation  which  needs 

to  be  justified. 

Suppose  that  we  want  to  solve  the  evolution  equation 

(13)  =  L^p  +  u ( t) L^p  ,  where 

and  are  in  general  unbounded  linear  operators  and  u(t)  is  a  given 

continuous  function.  Let  us  assume  that. .the  Lie  algebra  of  operators 

a{l  ,  L  }  has  a  finite  set  of  generators  {l  ,  L_ ,  ...  ,  L,} .  We  try  a 
12  12  d 

solution 

(14)  p(t)  =  exp  ^  (t)L1)exp(a2  (t)L2)  ...  exp(gd  (t)  Ld  )p  (o) 


where  p (o)  is  the  initial  condition.  For  ideas  similar  to  this  in  the 
context  of  ordinary  stochastic  differential  equations,  see  Kunita  [19]. 
Differentiating  the  above,  we  get 


=  g1(t)L1p  +  g2  (t)exp  ^  (t)L1)L2exp  (g2  (t)L2)  ...  exp  (gfl  (t)  Ld  )p  (o) 


+  g  (t)exp(g  (t)L 


)  .  . .  Ldexp  (g( 


L  explg  (t) L  p  (o')  . 


Now,  we  use  the  Campbell- Baker- Hausdorff  formula:  for  1  <  i,  j  <  d, 

d 


exp (tL . ) L 


i-S 


1  /  3 


m-1 


m 


(t)  L^exp  (tL_. )  repeatedly  to  obtain 
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(15)  ft  =  Fl(g(t)  ^  g  (t))  Lxp  +  ...  +  Fd^g(t)  ,g(t)^Ldp 

for  some  non-linear  functions  F_^  of  g(t)  =  (g^t),  ...  ,  gd  (t)j  and  g(t). 
For  (15)  to  define  a  solution  of  (13) ,  we  need 


=  1 
=  u  (t) 

=  0  for  j>2. 

For  the  Kalman- filter  problem  considered,  one  gets  (formally) 
gd  (t)  =  1 

y (t)  =  g2 (t)coshg1  (t)  +  g3 (t)sinhg1 (t) 

0  =  g2  (tjsinhg^^  (t)  +  g3  (t)  coshg1  (t) 

0  =  g4 (t)  -  g3 (t)g2 (t) 
gi  (0)  =  0  ,  i  =  1,  2 ,  ...  4. 

One  can  explicitly  solve  the  above  set  of  equations  to  obtain 

g2  (t)  =  JQ  cosh  (s)  dy  (s) 
g3  (t)  =  -J^sinh  (s)dy  (s) 

g^(t)  =  f t  (sinhs)  (coshs)ds  -  g2 (s ) sinh (s ) dy (s) 


Fd  ^g(t)  ,g(t)^ 
f2  (g(t)  »g(t)^ 
Fj  (g(t)  ,g(t)j 


where  we  have  now  used  stochastic  integrals. 
Substituting  the  above  in  (14)  and  using 


(e 


tLl, 


•<j>)  (s)  =  [ 

J— O 


G  (x,y,t, ) 4>  (y)dy  ,  t  >  0,  where 


G(x,y,t)  =  (27Tsinht) 


■i  r 

exp  I- 


j  (coth) (x2+y2)  +  xy/sinht 


.1  , 


one  gets 


P  (x 


/t)  =  /« Qk(z,t)exp(,-|p  1 


Dk (z,t)exp 

where  p(t)  =  tanht 

, ,  \  z  ,  /“'"sinhs  ,  ,  s 

m(t)  =  - —  +  I  - —  <3y(s) 

cosht  J  cosht 


(t) [x-m(t) ]  )pD (z) dz , 
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(and  k(z,t)  is  a  function  which  can  be  computed),  which  is  the 
familiar  Kalman-filter  solution. 

The  essential  point  in  proving  the  above  results  rigorously  is  to  note 


1  d" 


1  2 


that  v— g  +  -rx  generates  a  positivity-preserving  Hypercontractive 

2  dx  2 

1  d2  1  2  d 

semigroup  and  that  the  operators  -—  ^—2  +  — x  ,  x,  v-  have  a  common  dense 


2  dx^ 


dx 


set  of  analytic  vectors. 

Finally,  since  the  Lie  algebra  corresponding  to  the  Kalman  filter  is 
solvable  (14)  is  a  global  representation  for  the  solution. 

We  remark  that  the  Benes  problem  considered  in  Section  3.1  can  be 
integrated  in  exactly  the  same  fashion. 

Note  also  that  this  method  computes  the  fundamental  solution  of  the 
D-M-Z  equation  and  hence  these  ideas  can  be  applied  to  solve  Kalman 
filtering  problems  with  non-Gaussian  initial  conditions. 


4 . 2  Non-Existence  of  Finite- Dimensional  Filters 

In  an  earlier  part  of  this  section  "we  have  suggested  a  strategy  for 
obtaining  finite-dimensional  filters  when  the  Lie  algebra  of  the  filter 
has  a  "good"  ideal-structure  using  the  Brockett  Homomorphism  Ansatz.  We 
have  also  remarked  how  the  same  ansatz  may  lead  to  negative  results. 

Now,  in  section  3 . 2  we  have  shown  that  for  the  cubic-sensor  problem 
the  Lie  algebra  of  the  filter  is  isomorphic  to  the  W  /IR  .  In  [10] , 
Hazewinkel  and  Marcus  have  shown  that  W  /]R  cannot  be  realized  as  the  Lie 
algebra  of  vector  fields  with  smooth  coefficients  on  a  finite-dimensional 
smooth  manifold.  On  the  other  hand,  Sussmann  [11]  has  shown  that  if  there 
is  a  finite-dimensional  filter  for  a  conditional  statistic,  then  there 
exists  a  non- zero  homomorphism  of  Lie  algebras  according  to  the  Brockett 
prescription.  Some  further  work  combining  these  two  ideas  shows  that  no 
conditional  statistic  for  the  cubic-sensor  problem  can  be  computed  using 
finite-dimensional  filters . 
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We  conjecture  that  essentially  similar  results  can  be  proved  for  the 
following  class  of  filtering  problems: 

dx^  =  f (x  Ydt  +  dw^ 
t  t  t 

dyt  =  xtdt  +  dyt 
Suppose  that  f  satisfies: 
df  2 

+  f  =  V(x),  where  V(x)  is  an  even-positive  polynomial.  Then 

the  Lie  algebra  for  this  filtering  problem  is  an  algebra  which  is  isomorphic 
to  the  Weyl  algebra  W^/IR  ,  and  hence  all  the  above  results  of  this  section 
will  hold. 

4 . 3  Some  Recent  Positive  Results 

There  have  been  some  recent  positive  results  using  the  Lie-algebra 
formalism.  One  such  result  is  concerned  with  the  asymptotic  expansion  in  e 
of  the  unnormalized  conditional-density  for  the  filtering  problem 

dx^  =  ax^dt  +  dwt 
t  t  t 

<3y.  =  [x  +  £  (x  )k]dt  +  dy  ,  k>l 

t  t  t  t 

£ 

y  =  0;  p  (x)  Gaussian  , 
o  o 

where  £  is  some  small  positive  answer. 

For  this  class  of  problems  it  has  been  shown  [20]  ,  [21]  that  the 

.  .  £ 
various  terms  m  the  formal  asymptotic  expansion  of  p  (t,x)  can  be 

computed  by  finite-dimensional  filters  using  the  ideas  developed  in  this 

section. 

We  close  this  section  with  a  remark  on  the  identification  problem  for 
linear  stochastic  dynamical  systems.  These  problems  can  be  viewed  as 
non-linear  filtering  problems  and  lead  to  Lie  algebras  which  are  known  as 
"current-algebras"  in  mathematical  physics.  The  integration  of  these  Lie 
algebras  in  a  rigorous  manner  has  recently  been  done  in  the  work  of 
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Hazewinkel-Krishnaprasad -Marcus  [22]. 

5 .  Non-linear  Filtering  and  Hamilton- Jacobi- Bellman  Theory. 

An  entirely  different  geometric  approach  to  non-linear  filtering 
arises  by  giving  the  D-M-Z  equation  a  stochastic  control  interpretation  via 
an  exponential  transformation.  This  was  done  in  joint  work  with  Wendell 
Fleming  [6  ].  The  exponential  transformation  p  (t,x)  =  exp (-S (t ,x) )  leads  to 
Hamilton- Jacobi-Bellman  equation  for  S(t,x).  It  has  been  shown  in  [7] 
that  one  is  interested  in  maximum  a-posteriori  probability  filters  or 
maximum- likelihood  filters  then  these  filters  can  be  constructed  using  S 
(or  equivalently)  p.  The  assumption  that  S  is  a  Morse- function  (with 
parameters)  leads  to  an  interesting  geometric  theory  for  non-linear 
filtering.  This  will  be  developed  elsewhere. 
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APPENDIX 

Or.  Lie  Algebras,  Lie  Groups  and  Representations 

For  most  of  this  paper,  the  Cf°-manifold  we  will  be  interested  in  is 
!Rr'  (which  is  covered  by  a  sinale  coordinate  system)  . 

We  shall  say  that  a  vector  space  SB  over  2R  is  a  real  Lie  algebra,  if  in 
addition  to  its  vector  space  structure  it  possesses  a  product  SB  x  SB  SB‘ 

( X ,  Y )  [X, Y]  which  has  the  following  properties: 

(i)  it  is  bilinear  over  IR 

(ii)  it  is  skew  commutative  :  [X,Y]  +  [Y,X]  =  0 

X,Y,Ze^ 

(iii)  it  satisfies  the  Jacobi  identity: 

[X ,  [Y,  Z]  ]  =  [Y,  [Z,  X]  ]  +  [Z,  [X,  Y]  ]  =  0, 

Example:  M^CCR)  =  algebra  of  n  x  n  matrices  over  IR. 

If  we  denote  by  [X,Y]  =  XY  -  YX,  where  XY  is  the  usual  matrix  product, 
then  this  commutator  defines  a 

Lie  algebra  structure  on  M^dR)  . 

Example :  Let  SBXVi)  denote  the  C°°-vector  fields  on  a  C^-manifold  M. 

is  a  vector  space  over  R  and  a  C°°(M)  module.  (Recall,  a  vector  field  X  on 
M  is  a  mapping:  M  •+  T  (M)  :  p->-x  where  p£M  and  T^(M)  is  the  tangent  space 
to  the  point  p  at  M)  .  We  can  give  a  Lie  algebra  structure  to  &\1A)  by 
defining: 

O'  f  =  (XY  -  YX)  f  =  X  (Yf)  -  Y  (Xf)  ,  fecf^p) 

t?p  p  p  p 

(che  C°°-  functions  in  a  neighborhood  of  p)  ,  and 
[X, Y]  =  XY  -  YX. 

Both  of  these  examples  will  be  useful  to  us  later  on.' 

Let  SB  be  a  Lie  algebra  over  IR  and  let  {x^,  ...  ,  X^}  be  a  basis  of  SB 

(as  a  vector  space) .  There  are  uniquely  determined  constants 

c  £ IR  (l<r,s,p<n)  such  that 
-TSp 
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[X  ,X  ]  =  E  c  X 
r  s  s  s  r  s  p  p 

lip<n 

The  c  are  called  the  structure  constants  of  irrelative  to  the  basis 
rsp - 

{x, ,  ...  ,  X  }.  From  the  definition  of  a  Lie  algebra: 

1  n 

(i)  c  +  c  =0  (lir,s,p£n) 
rsp  srp 

(ii)  E  (c  c  +  c:c  +  ct  c  .  =0  (l5r,s,  t  ,u<n)  . 
l<p<n  rSP  ptU  Stp  PrU  trp  PSU 

Let  SB  be  a  Lie  algebra  over  IR.  Given  two  linear  subspaces  M,N  of  SB 

we  denote  by  [M,N]  the  linear  space  spanned  by  [X,Y],  XeM  and  YEN  -  A  linear 

subspace  K  of  SB  is  called  a  sub-algebra  if  [K,K]CK,  an  ideal  if  [£k]Ck. 

If  SB  and  SB'  are  Lie  alqebras  over  IR  and  TT  -.SB-+SB'  :  X-*TT(X),  a  linear 

map,  TT  is  called  a  homomorphism  if  it  preserves  brackets: 


[TT(X),  TT  (Y)  ]  =7T{[X,Y])  (X,Y  zSB). 

In  that  case  tt  (SB)  is  a  subalqebra  of  SB'  and  ker  tt  is  an  ideal  in  SB. 
Conversely,  let  SB  be  a  Lie  algebra  over  R  and  K  an  ideal  of  SB.  Let 
SB'  =  SB/Y.  be  the  quotient  vector  space  and  t\'JB>SB'  the  canonical  linear  map. 
For  X'  =  tt  (X)  and  Y'  =  tt  (Y)  ,  let 
[X'  , Y 1  ]  =  TT  ( [ X ,  Y ] )  . 


This  mapping  is  well-defined  and  makes  SB'  a  Lie  algebra  over  IR  and  TT  is 
then  a  homomorphism  of  SB  into  SB'  with  K  as  the  kernel.  SB'  =  SB/ K  is  called 
the  quotient  of  ,S?by  K. 

Let^  be  any  algebra  over  IP.,  whose  multiplication  is  bilinear  but  not 
necessarily  associative.  An  endomorphism  D  of  ^(considered  as  a  vector 
space)  is  called  a  derivation  if 

D(ab)  =  (Da)  b  +  a  (Db)  a,  b£^ 

If  and  are  derivations  so  is  [D^D^  =  DpD2  ~  D2D1 
The  set  of  all  derivations  on  ^(assumed  finite  dimensional)  is  a  subalgebra 
of  gl f&O ,  the  Lie  algebra  of  all  endomorphisms  of  W. 

For  us  the  notion  of  a  representation  of  a  Lie  algebra  is  very 
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important. 

Let  SB  be  a  Lie  algebra  over  IR  and  i /  a  vector  space  over  IR,  not 
necessarily  finite  dimensional.  By  a  representation  of  SB  in  1/  we  mean 
a  map. 

Tf  :  X  7T  (X)  :  SB-*  gl(l/)  (all  endomorphisms  of  l/),  such  that 

(i)  tt  is  linear 

(-ii)  tt([X,Y])  =tt(X)tt(Y)-tt(Y)tt(X)  . 

For  any  XeSB  let  adX  denote  the  endomorphism  of  SB 
adX  :  Y->  [ X ,  Y ]  (Y Z  SB)  ■ 

adX  is  a  derivation  of  SB  and  X^- adX  is  a  representation  of  SB  in  SB, 
called  the  adjoint  representation. 

Let  G  be  a  topological  group  and  at  the  same  time  a  differentiable 
manifold.  G  is  a  Lie  group  if  the  mapping  (x,y)  -»■  xy  :  GxG  -*  G  and  the 
mapping  x-*x  ^  :  G->-G  are  both  <S°- mappings . 

Given  a  Lie  group  G  there  is  an  essentially  unique  way  to  define  its 
Lie  algebra.  Conversely,  every  finite-dimensional  Lie  algebra  is  the  Lie 
algebra  of  some  simply  connected  Lie  group. 

In  filtering  theory  some  special  Lie  algebras  seem,  to  arise.  We  give 
the  basic  definitions  for  three  such  Lie  algebras. 

A  Lie  algebra  SB  over  R  is  said  to  be  nilpotent  if  adX  is  a  nilpotent 
endomorphism  of  SB,  'iXzSB .  Let  the  dimension  of  SB  be  m.  Then  there  are 
ideals  of  SB  such  that  (i)  dim  ^  =  m-j  ,  0<j<m. 

(ii)  _ 0  and  (iii)  [SB,^]Q^+1,  0<j5m-l. 

Let  g  be  a  Lie  algebra  of  finite-dimension  over  IR  and  write  Q) g  =  [g,g]. 
3)g  is  a  subalqebra  of  g  called  the  derived  algebra.  Define  3)^ g  (p^o) 
inductively  by 
3>°q  =  g 

2>pg  =3)@P~1a)  (p>l). 
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We  then  get  a  sequence  2°g2  S*^g2  ...  of  subalgebras  of  g.  g  is  said  to 
be  solvable  if2Pg  =  0  for  some  p>l. 

Examples 

(i)  Let  n>0  and  let  (p^,  ...  ,  pn,q^,  .  .  .  qn,z)  be  a  basis  for  a  real 
vector  space  Ifo'  Define  a  Lie  algebra  structure  on  'V by  [p^,q^]  = 

]  =  Z,  the  other  brackets  being  zero.  This  nilpotent  Lie  algebra 
^is  the  so-called  Heisenberg  algebra. 

(ii)  The  real  Lie  algebra  with  basis  (h,p, ,  ...  ,  p  ,q_ ,  ...  q  ,Z) 

1  n  1  n 

satisfying  the  bracket  relations 

[h,p^]  =  q^  ,  [h,q^]  =  p_^  ,  [p^q^]  =  z'  the  other  brackets  being 

zero  is  a  solvable  Lie  algebra,  the  so-called  oscillator  algebra.  Its 
derived  algebra  is  the  Heisenberg  algebra  JV. 

A  Lie  algebra  is  called  simple  is  it  has  no  nontrivial  ideals.  An 

infinite  dimensional  Lie  algebra  S£  is  called  pro-finite  dimensional  and 

filtered  if  there  exists  a  sequence  of  ideals  •••  such  SB/ ^  is 

finite-dimensional  for  all  i  and  =  { o) . 

l 

Infinite-Dimensional  Representations 

Let  g  be  a  finite  dimensional  Lie  algebra  and  G  its  associated 
simply  connected  Lie  group.  Let  H  be  a  complex  Hilbert  space  (generally 
infinite-dimensional) .  We  are  interested  in  representations  of  g  by 
means  of  linear  operators  on  H  with  a  common  dense  invariant  domain  2. 

Let  it  denote  this  representation. 

Similarly,  we  are  also  interested  in  representations  of  G  as 
bounded  linear  operators  on  H.  Let  T  be  such  a  representation.  That  is, 
T  :  G  -*■  L(H)  satisfies 

T(gig2)  =  T<gi)  X(g2)  ,  g^  g2  EG. 

The  following  problem  of  Group  representation  has  been  considered 
by  Nelson  and  others.  Given  a  representation  tt  of  g  on  H  when  does 
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there  exist  a  group  representation  (strongly  continuous)  t  of  G  on  H  such 
that 

T  ^exp  (tX)j  =  exp  (tir  {X)^J  VxeG 

Here  exp  (tuCx)^  is  the  strongly  continuous  group  generated  by  it  (X)  in 


the  sense  that 
d- 


dt 


exp 


(tn  (x)J  <J>  =  tt  (x) <j> 


and  exp  (tX)  is  the  exponential  mapping,  mapping  the  Lie  algebra  g  into 
the  Lie  group  G. 

Let  X. ,  ...  X,  be  a  basis  for  g.  A  method  for  constructing  T 
1  d 


locally  is  to  define 

T  ^exp  (t^X^)  ...  exp(t  S  )j  =  exp( 


t^TT  (X^)  J  ...  exp  (tdTT(xd)) 


A  sufficient  condition  for  this  to  work  is  that  the  operator 
identity 


Ztn 

—  [adA.]  A.exp(tA.) 
n=0n ■  3  ^  3 

holds  for  A_,  =  ttCX^)  ,  1<  j  ,  j<d. 

It  is  a  well  known  fact,  that  many  Lie  algebra  representations  do 

not  extend  to  Group  representations.  An  example  is  the  representation 

of  the  Heisenberg  algebra  consisting  of  three  basis  elements  by  the 

operators  {-ix,  —  ,  -i}  on  L  (IR, )  with  domain  C  (3R,)  which  does  not 
dx  +  o  + 

extend  to  a  unitary  representation  (since  essential  self-adjoihtness 
fails) . 

Although  in  filtering  theory  we  are  not  interested  in  unitary  group 
representation,  nevertheless  these  ideas  will  serve  as  a  guide  for 
integrating  the  Lie  algebras  arising  in  filtering  theory. 


,  n. 


